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ELECTRONIC BOOK AND GRAPHICAL USER INTERFACE 

TO PROVIDE CONTROL THEREOF 

Related Invention 

5 

The present invention is related to the following 
invention which is assigned to the same assignee as the present 
invention : 

"System and Method for Limiting Access to a Book Card n , 
10 having Serial No. 08/572,346, filed December 14, 1995. 

"Apparatus and Method for Storing and Presenting Text", 
having Serial No. 08/572,451, filed December 14, 1995. 

"Method and Electronic Book for Creating a Plurality of 
Versions of a Book", having Serial No. 08/572,485, filed 
15 December 14, 1995. 

"Electronic Book Diary and Method For Use Therefore", 
having Serial No. 08/572,602, filed December 14, 1995. 

"Method and Device for Inhibiting the Operation of an 
Electronic Device During Take-Off and Landing of an Aircraft", 
20 having Serial No. 08/572,603, filed December 14, 1995. 

"System for Inhibiting the Operation of an Electronic 
Device During Take-Off and Landing of an Aircraft", having 
Serial No. 08/572,484, filed December 14, 1995. 

"Method for Abridging Text", having Serial No. 08/572,834, 

2 5 filed December 14, 1995. 

"A Method of Substituting Names in an Electronic Book", 
having Serial No. 08/572,480, filed December 14, 1995. 

"System and Method of Authoring Tools for an Electronic 
Book", having Serial No. 08/572,358, filed December 14, 1995. 

3 0 "System and Method for an Automatic Library for a — 

Plurality of Book Cards", having Serial No. 08/572,482, filed 
December 14, 1995. 

"Electronic Book and Method of Selecting a Primary Font 
and a Primary Size for Displaying Text Therewith", having 
3 5 Serial No. 08/572,407, filed December 14, 1995. 

"Electronic Book and Graphical User Interface for 
Selecting a Book to Read Therewith" , having Serial No. 
08/572,406, filed December 14, 1995. 



WO 97/22 1 07 PCT/US96/200 1 3 

2 

"Electronic Book and Method of Storing at Least One Book 
in an Internal Machine -Readable Storage Medium", having Serial 
No. 08/572,593, filed December 14, 1995. 

"Electronic Book and Method of Annotation Therefor" , 
5 having Serial No. 08/572,367, filed December 14, 1995. 

"Electronic Book and a Method of Displaying a Relative 
Position of a Current Page of a Book Therefor", having Seria.1 
No. 08/572,373, filed December 14, 1995. 

"Method and System for Encoding a Book for Reading Using 
10 an Electronic Book", having Serial No. 08/572,468, filed 
December 14, 1995. 

"Electronic Book and Method of Displaying an Animated Page 
Turn Therefor", having Serial No. 08/572,405, filed December 
14, 1995. 

1 5 "Electronic Book and Method of Controlling a Rate of 

Information Displayed Thereby", having Serial No. 08/572,372, 
filed December 14, 1995. 

"Reusable Housing and Memory Card Therefor", having Serial 
No. 08/572,413, filed December 14, 1995. 

2 0 "Electronic Book and Method of Displaying at Least One 

Reading Metric Therefor", having Serial No. 08/572,842, filed 
December 14 , 1995. 

"Electronic Book and Method of Creating a Personal Log of 
Reading Activity Therefor", having SeriaJ No. 08/572,456, filed 

2 5 December 14, 1995. 

"Electronic Book Having Highlighting Feature", having 
Serial No. 08/572,469, filed December 14, 1995. 

"Electronic Book and Method of Capturing and Storing a 
Quote Therein", having Serial No. 08/572,601, filed December 

3 0 14, 1995. - 

The subject matter of the above- identified related 
inventions are hereby incorporated by reference into the 
disclosure of this invention. 

3 5 Field of the Invention 



The present invention relates to electronic books having 
the look and feel of real paper books and methods ot providing 
control of an electronic book to a user. 
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Background of the Invention 

Various types of hand-held electronic reading devices have 
5 been proposed to electronically display textual information for 
reading by a user. A typical hand-held electronic reading 
device includes a display device to display the textual 
information and a user interface which allows a user to 
navigate through the textual inf orrnation and access various 
10 features of the electronic reading device. The display device 
and the user interface are incorporated in a hand-held housing 
to facilitate portability of the electronic reading device. 

Many hand-held electronic reading devices have a user 
interface in the form one or more external buttons . The 

1 5 buttons are depressed in a predetermined manner either to 

navigate through the textual information or to access various 
features of the device. However, many hand-held electronic 
reading devices implement the user interface in a manner which 
does not provide a simple, intuitive, or efficient method for 
20 navigating the textual information or for accessing the 
features . 

U.S. Patent No. 5,239,665 to Tsuchiya discloses an 
electronic book having six keys incorporated in a housing and 
adjacent to a display device. The six keys are utilized to 

2 5 navigate through book information stored in a memorv means and 

to access various features of the electronic book. Each of the 
six keys has a location on the housing which is unrelated to 
its function. 

The lack of simplicity of using current hand-held 

3 0 electronic reading devices along with the lack of comfort in - 

handling many of these devices result in some people preferring 
to read a real paper book rather than using a hand- held 
electronic reading device. 

3 5 Brief Description of the Drawings 
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The invention is pointed out with particularity in the 
appended claims. However, other features of the invention will 
become more apparent and the invention will be best understood 



WO 97/22 1 07 PCT/l JS96/200 1 3 

4 

by referring to the following detailed description in 
conjunction with the accompanying drawings in which: 

FIG. 1 is a view of an embodiment of an electronic book in 
a closed position; 
5 FIG . 2 is a view of the embodiment of the electronic book 

of FIG. 1 in an open position; 

FIG. 3 is a block diagram of an embodiment of the 
electronic book; 

FIG. 4 is an illustration of various hot spot locations 
I 0 used to provide control of the electronic book to a user; 

FIG. 5 is an illustration of a library screen display 
using an embodiment of the electronic book; 

FIG. 6 is an illustration of a user- initiated event to 
open the desired book from the library screen; 

1 5 FIG. 7 is an illustration of a first page of a book 

displayed on an embodiment of the electronic book; 

FIG. 8 is an illustration of a title page of a book 
displayed on an embodiment of the electronic book; 

FIG. 9 is an illustration of a font selection page 

2 0 displayed on an embodiment of the electronic book; 

FIG. 10 is an illustration of the title page of the book 
which is displayed upon exiting the font selection page; 

FIG. 11 is an illustration of a system control page 
displayed in an embodiment of the electronic book; 

2 5 FIG. 12 is an illustration of the title page of the book 

which is displayed upon exiting the system control page; 

FIG. 13 is an illustration of the title page of the book 
wherein a radio frequency link option is selected; 

FIG. 14 is an illustration of the title page of the book 

3 0 wherein a pacing control option is selected by a user; — 

FIG . 15 is an illustration of a pacing control page 
displayed in an embodiment of the electronic book; 

FIG. 16 is an illustration of the title page of the hook 
which depicts other user-initiated options; 
3 5 FIG. 17 is an illustration of a page marked by a dog ear 

for use in embodiments of the electronic book; 

FIG. 18 is an illustration of a dog ear dialog box used in 
embodiments of the electronic book; 
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FIG. 19 is an illustration of a user selecting a portion 
of a page of text; 

FIG. 20 is an illustration of an option selection dialog 
box used in embodiments of the electronic book; 
5 FIG. 21 is an illustration of an annotation display used 

in embodiments of the electronic book; 

FIG. 22 is an illustration of a marker used to indicate 
that a page has an annotation associated therewith; 

FIG. 23 is an illustration of a user selecting a set 

1 0 bookmark option in the option selection dialog box; 

FIG. 24 is an illustration of the page of FIG. 23 having a 
bookmark displayed thereon; 

FIG. 25 is a flow diagram of an event loop performed in an 
embodiment of the electronic book; 
15 FIG. 26 is a flow diagram of steps performed in an 

embodiment of a library graphical user interface routine for 
use in the electronic book; 

FIGS. 27 and 28 show flow diagrams of an embodiment of the 
routine to display pages of text in the electronic book; 

2 0 FIG. 29 is a flow diagram of steps performed to display a 

current page in the electronic book; 

FIG. 30 is a flow diagram of steps performed in an 
embodiment of an annotation subroutine; 

FIG. 31 is a flow diagram of steps performed in an 

2 5 embodiment of a quote capture subroutine; 

FIG. 32 is a flow diagram of steps performed in an 
embodiment of a dog ear subroutine; 

FIG. 33 is a flow diagram of steps performed in an 
embodiment of a pacing control subroutine; 

3 0 FIG. 34 is a flow diagram of steps performed in an ~ 

embodiment of the font selection subroutine; and 

FIG. 35 is a flow diagram of steps performed in an 
embodiment of the system control subroutine. 



3 5 Detailed Description of a Preferred Embodiment 

Embodiments of the present invention advantageously 
provide an electronic book with an intuitive graphical user 
interface for navigating through a book and for controlling 
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various features of the electronic book . Various portions of a 
touchscreen integrated in the electronic book are designated in 
an intuitive manner and consistent with a metaphorical book to 
receive user- initiated events or actions to control the 
5 operation of the electronic book. 

FIG . 1 is a view of an embodiment of an electronic book in 
a closed position. The electronic book has a book-shaped 
housing 100 having the look and feel of a real, paper book. 
The book-shaped housing 100 has a first housing member 102 

1 0 pivotably connected to a second housing member 104 to 

facilitate opening and closing in a book-like manner. The 
first housing member is partially formed by a book-like, front 
cover member 106. In a similar manner, the second housing 
member 104 is partially formed by a book-like, back cover 

15 member 108. The front cover member 106 and the back cover 
member 108 are pivotably connected by a spine member 110. 

To better provide the look and feel of a real book, the 
front cover member 106 and the back cover member 108 have an 
exterior made of a material used in real book covers. Examples 

20 of such a material include, but are not limited to, leather, 
simulated leather, vinyl, and a woven fabric such as cotton. 
The exterior can either be permanently affixed to the front 
cover member 106 and the back cover member 108, or be in the 
form of a removable jacket. 

2 5 In addition to the front cover member 106, the first 

housing member 102 is partially defined by an enclosure 112 . 
Similarly, the second housing member 104 is partially defined 
by an enclosure 114 in addition to the back cover member 108. 
When the electronic book is in the closed position, the 

3 0 enclosure 112 and the enclosure 114 have an external appearance 

of edges of pages of a real, paper book. In particular, the 
enclosures 112 and 114 define a top edge 116, a bottom edge 
118, and a foredge 120 which appear as the top edge, the bottom 
edge, and the foredge, respectively, of a real, paper book. 
3 5 The top edge 116, the bottom edge 118, and the foredge 120 are 
recessed with respect to the front cover member 106 and the 
back cover member 108 . 

FIG. 2 is a view of the embodiment of the electronic book 
of FIG. 1 in an open position. It is preferred that the first 
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housing member 102 and the second housing member 104 be 
substantially symmetric so that the front cover member 106, the 
back cover member 108, and the spine member 110 rest 
substantially flat on a flat surface in the open position. The 

5 substantial symmetry makes the electronic book feel like a 

real, paper book being opened to one of its middle pages. As a 
result, the electronic book can be comfortably held and read in 
a manner consistent with a paper book. 

A touchscreen 130 is integrated in the book-shaped housing 

0 100 to be accessible when the book-shaped housing 100 is opened 
in the book-like manner. In the embodiment illustrated in FIG. 
2, the touchscreen 130 is integrated with the enclosure 114 of 
the second housing member 104. Optionally, a second 
touchscreen 132 can also be integrated in the book-shaped 

5 housing. As illustrated, the second touchscreen 132 can be 
integrated with the enclosure 112 of the first housing member 
102. 

The touchscreen 130 and the second touchscreen 132 each 

include a touch-sensitive panel over a display device. Behind 

0 the display device can be a backlighting element. 

The touchscreen 130 and the second touchscreen 132 may 

provide either a color display or a monochrome display 

depending on a particular model of the electronic book. To 

provide their touch sensitivity, the touchscreen 130 and the 

5 second touchscreen 132 can utilize analog resistive technology 

as is known in the art. It is noted, however, that other 

technologies for providing touch sensitivity can also be 
utilized. 

It is preferred that the touchscreen 130 and the second 
0 touchscreen 132 be capable of providing backlighting to allow - 
use of the electronic book in poorly-lit or dimly-lit 
environments. More preferably, the touchscreen 130 is capable 
of backlighting selected portions or subsets of the entire 
touchscreen 130. Here, the electronic book can provide a 
5 power-saving mode wherein only a portion of the touchscreen 130 
being viewed by a user is actively backlit. 

The book-shaped housing includes a receiving slot 134 
which physically receives a removable machine-readable storage 
medium 136. The removable machine-readable storage medium 136 
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contains machine— readable data representative of text from a 
book. Optionally, the machine-readable data is also 
representative of graphical information within the book. It is 
noted that the term "book" should be construed broadly as any 
5 written or printed composition having textual information which 
is read by an individual. Hence, the term "book" should be 
inclusive of books, magazines, newspapers, or the like. 

The text and the graphical information contained in the 
removable machine-readable storage medium 136 are displayed on 

10 the touchscreen 130. The second touchscreen 132 can be 

included to display graphical information while the touchscreen 
130 displays text. As another option, the touchscreen 130 and 
the second touchscreen 132 can display neighboring pages of the 
book. Further, the touchscreen 130 and the second touchscreen 

15 132 can be utilized to simultaneously view two books. The 

second touchscreen 132 can also be utilized in a second level 
operating system, which is herein called an advanced reader 
graphical user interface. The functionality of the second 
touchscreen 132 can be selected by the user using a switch or 

2 0 the advanced reader graphical user interface in the electronic 
book . 

It is noted that there are a number of ways to encode the 
text and the graphical information within the book for storage 
on the removable machine-readable storage medium 136. In one 

2 5 embodiment, the removable machine-readable storage medium 136 

contains a series of pointers which point to words contained in 
a dictionary within the electronic book. Words which are not 
contained in the dictionary are located in a customized 
dictionary on the removable machine-readable storage medium 

3 0 136. In this way, the words to be presented on the touchscreen 

130 are selected with minimal storage requirements in the 
removable machine-readable storage medium 136. 

Preferably, the removable machine-readable storage medium 
136 is in the form of either a smart card or a PCMCIA card. 
3.5 Here, the receiving slot 134 is shaped to receive either a 
smart card or a PCMCIA card. 

The book-shaped housing 100 further defines a power- 
receiving port 138 and a data-receiving port 140. The power- 
receiving port 138 receives a plug or other type of connector 



m 



WO 97/22107 PCT/US96/200I3 

9 

to supply power to the electronic book. Power supplied to the 
electronic book via the power receiving port 138 can be used to 
directly operate the electronic book or to recharge batteries 
internal to the electronic book. In one embodiment of the 
5 electronic book ; the spine member 110 is shaped to receive a 
combination of battery cells which can be recharged via the 
power-receiving port 138. If the second touchscreen 132 is not 
used, the enclosure 112 of the first housing member 102 can be 
used to store extra batteries and/or extra book cards. 
1 0 The data port 140 is utilized to communicate signals 

representative of machine-readable data between the electronic 
book and an external device. The data port 14 0 can be used, 
for example, to receive machine-readable data signals 
representative of text and graphics in a book from the external 

1 5 device for storage in the electronic book. In this manner, the 

data port 140 provides an alternative to the receiving slot 134 
for receiving text and graphics of a book. Additionally, the 
data port 140 can be utilized to transmit machine-readable data 
contained within the electronic book to the external device. 

2 0 Preferably, the electronic book is automatically activated 

(i.e., automatically turns on) when in the open position, and 
is automatically deactivated (i.e. automatically turns off) 
when in the closed position. To this end, the electronic book 
can include a magnet 142 incorporated within one of the first 

2 5 housing member 102 or the second housing member, and a reed 

switch 144 incorporated within the other housing member. When 
the electronic book is in the closed position, the magnet 142 
is proximate to the reed switch 144 . The magnetic field 
generated by the magnet 142 causes the reed switch 144 to 

3 0 assume a first switch position which deactivates the electronic 

book. When the electronic book is in the open position, the 
magnet 14 2 is distant from the reed switch 144. In absence of 
a significant magnetic field, the reed switch 144 returns to a 
second switch position which activates the electronic book. 
3 5 It is noted that in alternative embodiments, the 

electronic book is activated and deactivated by an external 
switch or button (not specifically illustrated) rather than by 
the reed switch 144. 
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FIG . 3 is a block diagram of an embodiment of the 
electronic book. An interface 150 receives the removable 
machine-readable storage medium 136 containing machine-readable 
data representative of text and graphics from a book. In a 
5 preferred embodiment of the present invention, the interface 
150 comprises a PCMCIA interface which receives a removable 
machine-readable storage medium in the form of a PCMCIA card. 
Physically/ the interface 150 is proximate to the receiving 
slot 134 illustrated in FIG. 2. 

10 In general, it is preferred that the interface 150 be 

capable of receiving an external device other than a machine- 
readable storage medium. Further, it is preferred that the 
interface 150 be capable of receiving a plurality of external 
devices. To these ends, the interface 150 can comprise a 

15 plurality of similar interfaces, such as a plurality of PCMCIA 
interfaces. Here, the electronic book can simultaneously 
receive two or more of a PCMCIA memory card, a PCMCIA modem, or 
another PCMCIA device. 

A processor 152 is in communication with the interface 150 

2 0 to read the machine-readable data from the removable machine- 
readable storage medium 136. The processor 152 can be in the 
form of a microprocessor, a custom integrated circuit, an 
application specific integrated circuit, or a programmable 
logic array, for example. Physically, the processor 152 is 

2 5 housed within the book-shaped housinq 100. 

The touchscreen 130 is in communication with the processor 
152 to display a page of the text and/or the graphics 
represented by the machine-readable data. Further, the 
touchscreen 130 acts as an input device to receive user- 
30 initiated events, i.e. user-initiated actions, and communicate"" 
these user-initiated events or actions to the processor 152. 

An internal machine-readable storage medium 154 is in 
communication with the processor 152 to support a number of 
operative features of the electronic book. The internal 

3 5 machine-readable storage medium 154 can include one or more 

memory devices, such as a random access memory, a read-only 
memory, and/or an electronically erasable and programmable 
read-only memory (EEPROM) . 



1 
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A computer program or other form of software or firmware 
is stored in the internal machine-readable storage medium 154 . 
The computer program directs the processor 152 to support the 
operative features of the electronic book. Preferably/ the 
5 computer program includes an event loop that processes and 
responds to user-initiated events and actions. More 
specifically, received events are placed in an event queue in 
the internal machine-readable storage medium 154 . Each of the 
received events is processed and removed from the event queue. 
1 0 As a result, a user can initiate a number of events or actions 
without having to wait for previous actions to be processed. 

The internal machine-readable storage medium 154 can also 
include a dictionary to which pointers stored in the removable 
machine-readable storage medium 136 point. By including the 

1 5 dictionary within the electronic book, less storage space is 

required on the removable machine-readable storage medium 136 
to store the text from the book. 

Further, the internal machine-readable storage medium 154 
can contain machine-readable data representative of text and 

2 0 graphics from a book. Here, the processor 152 reads the 

machine-readable data from the internal machine-readable 
storage medium 154 and commands the touchscreen 130 to display 
pages of the text and graphics. 

Signals are communicated between the electronic book and 

2 5 an external device via either a data interface 156 in 

communication with the processor 152, via an antenna 158 and a 
radio frequency modem 160 in communication with the processor 
152, or via an infrared transceiver 161 in communication with 
the processor. As another option, communication between the 

3 0 electronic book and the external device can be effectuated ~ 

using either a smart communication card or a PCMCIA 
communication card received by the interface 150. Here, a 
PCMCIA modem card or a PCMCIA infrared transceiver card can be 
utilized, for example, for external communication. 
3 5 Optionally, a voice synthesizer 162 is included in the 

electronic book to provide a spoken auditory display of pages 
of the text read from either the removable machine-readable 
storage medium 136 or the internal machine-readable storage 
medium 154. In one embodiment, the processor 152 directly 
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converts the text from the book into speech signals for the 
voice synthesizer 162. Optionally/ control codes can be 
provided within the removable machine-readable storage medium 
136 to allow words to be pronounced or emphasized in different 
5 ways. Further, the control codes can command the words to be 
spoken in either a male voice, a female voice, or a child's 
voice. The synthesized voice can be sampled (such as using the 
user's voice) or can be a computer-synthesized voice. 

As an alternative, a custom voice dictionary can be 

10 provided to augment a general voice dictionary stored in the 
electronic book. The customized voice dictionary can be used 
for alternative pronunciations, voices, and emphasis. 

The voice synthesizer 162 is either permanently integrated 
in the electronic book or is a removable accessory. To 

15 facilitate removability, the voice synthesizer 162 can be 

embodied within a smart card or a PCMCIA card for reception by 
the interface 150. Alternatively, the voice synthesizer 162 
can communicate with the processor 152 via an accessory 
interface bus 163. In a similar manner, the RF modem 160 

2 0 and/or the second touchscreen 132 can communicate with the 
processor 152 via the accessory interface bus 163. 

Before giving a detailed description of steps performed by 
the elements of FIG. 3 for the various embodiments of the 
present invention, a functional description of a particular 

2 5 embodiment of the electronic book will now be described. This 

embodiment is based on a single touchscreen, namely the 
touchscreen 130, to display the text and the graphics of the 
book and to allow a user to control the electronic book. It is 
noted, however, that the teachings herein can also be applied 

3 0 to a dual touchscreen embodiment which further includes the ~ 

second touchscreen 132. Furthermore, it is noted that the 
teachings herein are not limited to the use of a touchscreen, 
and hence, can be applied to an electronic book containing any 
type of display device (such as a liquid crystal display or a 
3 5 cathode ray tube, for example) and any type of input device 

(such as a series of buttons, a mouse, a trackball, a lightpen, 
or a touchpad, for example). 

FIG. 4 is an illustration of various hot spot locations 
used to provide control of the electronic book to a user. A 
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page of the text represented by the machine-readable data read 
from either the removable machine-readable storage medium 136 
or the internal machine-readable storage medium 154 is 
displayed on a display portion 168 of the touchscreen 130. The 

5 display portion 168 is also utilized to display graphics 
represented by the machine-readable data. 

A first hot spot portion 17 0 of the touchscreen 130 is 
designated for receiving a predetermined user-initiated event 
which requests that a subsequent page of the text be displayed 

0 on the touchscreen 130. Hence, the first hot spot portion 170 
can be synonymously referred to as an "advance page portion" or 
an "advance page hot spot" for receiving an advance page event. 
In the embodiment illustrated in FIG. 4, the first hot spot 
portion 170 includes a top margin portion 172, a side margin 

5 portion 174, and a bottom margin portion 176 of the touchscreen 
130. The top margin portion 172 is located above the display 
portion 168, the side margin portion 174 is located beside the 
display portion 168, and the bottom margin portion 176 is 
located below the display portion 168. 

0 A second hot spot portion 178 of the touchscreen 130 is 

designated for receiving a predetermined user-initiated event 
which requests that a previous page of the text be displayed. 
Hence, the second hot spot portion 178 can be synonymously 
referred to as a "page back portion" or a "page back hot spot" 

5 for receiving a page back event. In the embodiment illustrated 
in FIG. 4, the second hot spot portion 178 is located beside 
the display portion 168 of the touchscreen 130 and opposite the 
side margin portion 174. 

A third hot spot portion 180 of the touchscreen 130 is 

0 designated for receiving a predetermined user-initiated event - 
which requests that a pre-marked page be displayed on the 
touchscreen 130. In the embodiment of FIG. 4, the third hot 
spot portion 180 is located in an upper portion of the 
touchscreen 130 and is shaped as a bookmark graphic 182. 

5 Hence, the third hot spot portion 180 can be synonymously 

referred to as a "bookmark portion" or a "bookmark hot spot". 

A fourth hot spot portion 184 of the touchscreen 130 is 
designated for receiving a predetermined user-initiated event 
to close the current book being read and to request that a 
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library screen be displayed on the touchscreen 130. The 
library screen is utilized by a user to select a book to read 
from a plurality of books within a library. Hence, the fourth 
hot spot portion 184 can be synonymously referred to as a 
5 "close book portion" or a "close book hot spot" for receiving a 
close book event . 

A fifth hot spot portion 186 of the touchscreen 130 is 
designated for receiving a predetermined user-initiated event 
which requests that the displayed page be marked. In the 
10 embodiment of FIG. 4, the fifth hot spot portion 186 is located 
in an upper corner of the touchscreen 130. In this embodiment/ 
the fifth hot spot portion 186 of the touchscreen 130 is 
utilized for dog-earring pages of the book. Hence, the fifth 
hot spot portion 186 can be synonymously referred to as a "dog 

1 5 ear portion" or a "dog ear hot spot" for receiving a dog ear 

event . 

A sixth portion 188 of the touchscreen 130 is designated 
to provide a depth indication representative of how much of the 
book is left to be read. In the embodiment illustrated in FIG. 

2 0 4, the sixth portion 188 is located above the display portion 

168. The second hot spot portion 3 78 can be utilized in 
conjunction with the sixth portion 188 to provide the depth 
indication . 

In the embodiment of FIG. 4, the display portion 168, the 

2 5 first hot spot portion 170, the second hot spot portion 178, 

the third hot spot portion 180, the fourth hot spot portion 
184, and the fifth hot spot portion 186 are mutually exclusive 
(i.e. non-overlapping) portions of the touchscreen 130. 
However, in alternative embodiments of the present invention, 

3 0 these portions may not be mutually exclusive, and hence may ~ 

overlap. Further, some embodiments of the present invention 
may utilize different sizes and positions for the above- 
described hot spot portions . 

Preferably, the hot spot portions are motion sensitive so 
3 5 that a touch event, a touch- and- hold event, and a drag event 
can be sensed to initiate differing responses. For example, a 
page back event can be received in the form of a flipping 
motion (i.e. a short stroke) across the second hot spot portion 
.178. 




WO 97/22107 PCT/US96/20013 

] 5 

FIG. 5 is an illustration of a library screen displayed 
using an embodiment of the electronic book. In a preferred 
embodiment, the library screen is displayed upon opening the 
electronic book or activating the electronic book. The library 
5 screen includes a rearward graphical book representation 200 
having a graphical spine portion 202. A forward graphical book 
representation 204 is displayed in front of the rearward 
graphical book representation 200. The forward graphical book 
representation 204 has a graphical spine portion 206 and a 
10 graphical front cover portion 208. A title 210 of a book 

currently being read is displayed on the forward graphical book 
representation 204. In the embodiment illustrated in FIG. 5, 
the title 210 is displayed on the graphical spine portion 206 
of the forward graphical book representation 204. 

1 5 Upon receiving a user-initiated event in which a portion 

of the rearward graphical book representation 200 is selected, 
a title of another book or books of a plurality of books in a 
library is displayed in place of the title 210 on the forward 
graphical book representation 204. In a preferred embodiment, 

2 0 the portion of the rearward graphical book representation 200 

selected in this user-initiated event is within the graphical 
spine portion 202. 

The titles of the books in the library can be obtained 
from a storage medium (which contains the books) installed in 

2 5 the electronic book. Alternatively, the titles of the books 

can be obtained by a connection to an information service 
providing books or other information in real time. As another 
alternative, the titles and the books can be accessed on demand 
from a world-wide web page. 

3 0 A user can scroll through the library of books by ~ 

repeatedly touching the spine portion 202 with his or her 
finger 212 until a desired book title is pulled into view. 
When the spine portion 202 is selected for a last of the 
plurality of books, the title of the first book is displayed. 
3 5 In this manner, the user can rotate through the library of 
books until a desired book is in front. 

FIG. 6 is an illustration of a user-initiated event to 
open the desired book from the library screen. The forward 
book is opened upon receiving a user-initiated event in which a 
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portion of the forward qraphical book representation 204 is 
selected. This user-initiated event can include, for example , 
the user touching the front cover portion 208 of the forward 
graphical book representation 204 using his or her finger 212. 
5 In response to this user— initiated event, the book indicated by 
a title 214 is opened. If the book is previously unread, the 
book is opened to page one. If the book has been read before, 
the book opens to a page which was last read. 

FIG. 7 is an illustration of a first page of a book 

1 0 displayed on the touchscreen 130 upon exiting the library 

screen. To display the first page of the book, the machine- 
readable data representative of text and graphics from the book 
is read from either the removable machine-readable storage 
medium 136 installed in the electronic book, or from the 
15 internal machine-readable storage medium 154. Upon reading the 
machine-readable data, a page of the text and/or the graphics 
is then displayed on the touchscreen 130. As shown, the text 
is displayed to appear as a standard page in a real book . 

If a user— initiated event is received in which a user 

2 0 selects the second hot spot portion 17 8, i.e. the page back 

portion, of the touchscreen 130 when the book is on the first 
page, then a title page containing system controls is 
displayed . 

FIG. 8 is an illustration of a title page of a book 

2 5 displayed on an embodiment of the electronic book. Information 

which is displayed on the title page includes a book title 220, 
author information 222, copyright information 224, a Library of 
Congress number 226, and publisher information 228. Also 
displayed are statistics such as a total number of pages 230 in 

3 0 the book, a number of pages left to be read 232, and an elapsed 

reading time 234 . 

A number of control options are also displayed. These 
control options include, but are not limited to, a pacing 
control option 236, a font selection option 238, a system 
3 5 control option 24 0, a read-to-me option 242, and a radio 

frequency (RF) link option 244. Any of these control options 
can be initiated by a respective user-initiated event 
indicative of a user selecting the option. As illustrated in 
FIG. 8, a user is initiating a font selection routine by 
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touching the font selection option 238 using his or her finger 
212. 

FIG. 9 is an illustration of a font selection page 
displayed on an embodiment of the electronic book. The font 
5 selection page is displayed upon an initiation of the font 
selection routine. 

Displayed on the font selection page are a number of 
font/size combination options. Each option is in the form of a 
word displayed using a specific font and a specific size in 
10 accordance with the font/size combination. A user selects a 
desired font/size combination by viewing how words appear in 
the various combinations, and selecting the combination which 
is desired. For example, in FIG. 9, the user is selecting a 
desired font/size combination by selecting a word 250 displayed 
1 5 in the desired font/size combination using his or her finger 
212. 

The fonts can be selected from internal fonts and custom 
fonts provided on the medium provided by a publisher. For 
example, a user may select a Gothic font provided on a medium 
2 0 containing a Shakespeare work instead of default fonts (e.g. 
Courier, Helvetica, Avant Garde) within the electronic book. 

Upon selecting the desired font/size combination, the 
electronic book automatically flips back to the title page 
containing the system controls. Thereafter, the electronic 

2 5 book uses the desired font/size combination as a primary 

font/size combination to display the text of the book. Titles 
and headings in the book are enlarged and bolded based upon the 
primary font/size combination. Other portions of text can be 
italicized based on the primary font. However, it is preferred 

3 0 that the body of the text never be displayed smaller than the - 

size selected in the primary font/size combination. In some 
embodiments, it may be preferred to display footnotes in a size 
smaller than the size selected. 

FIG. 10 is an illustration of the title page of the book 
3 5 which is displayed upon exiting the font selection page. Here, 
a user is shown to initiate a system control routine by 
selecting the system controls option 240 using his or her 
finger 212. 
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FIG. 11 is an illustration of a system control page 
displayed in an embodiment of the electronic book. The system 
control page is displayed upon executing the system control 
routine . 

5 The system control page provides a number of display 

controls including a contrast control 254, a tint control 256, 
and a color control 258. Each of these controls provides a 
discrete number of control values which can be directly 
selected by a user. Further, each control value is displayed 

10 in a graphical manner consistent with the result of its 

selection. For example, the contrast control 254 includes a 
high contrast graphical representation 262, an intermediate 
contrast graphical representation 264 , and a low contrast 
graphical representation 266. The graphical representations 

15 262, 264, and 266 are of the same graphical image, but arc 
displayed using different contrast control values. Hence, a 
user can visually determine a desired contrast by viewing the 
graphical representations 262, 264 and 266. In a similar 
manner, the tint control 256 and the color control 258 each 

2 0 display a predetermined graphical image using a discrete number 
of tint control values and color control values, respectively. 

Preferably, the display of the graphical representations 
within the display controls are unaffected by current values of 
selected ones of the controls. In one preferred embodiment, 

2 5 the display of the graphical representations is independent of 

all of the current values. For example, the display of the low 
contrast representation 266 can be independent of the current 
contrast control value, the current tint control value, and the 
current color control value. In another preferred embodiment, 

3 0 the display of the graphical representations in each control rs 

independent of the current value of that control, but depend on 
the current value of the other controls. Here, for example, 
the display of the low contrast representation 266 is 
independent of the current contrast control value, but 
3 5 dependent upon the current tint control value and the current 
color control value. Using either of these two embodiments, a 
user can immediately determine a result of each control value 
selection before actually performing the selection. 

The system control page also includes a sound control 267. 



♦ 



* 
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The sound control 267 is illustrated to have a discrete number 
of sound intensity values which can be selected by a user. In 
the embodiment of FIG. 11 , the sound intensity values are 
monotonicaily related to the size of an ear displayed on the 
5 sound control 267. An ear 268 having a slash therethrough is 
indicative of an option to turn off the sound. For the purpose 
of illustration, FIG. 11 shows a user selecting an intermediate 
sound intensity by touching an ear graphic 269. The user then 
returns to the system control page by touching the second hot 

10 spot portion 178, i.e. the page back hot spot, of the 
touchscreen 130. 

It is noted that the controls on the system control page 
can provide continuous, rather than discrete, control of the 
control values in alternative embodiments of the electronic 

15 book. Here, for example, the ear size and the volume can 
increase or decrease based on finger selection movement. 

A pad area 270 of the system control page is utilized for 
testing motions such as a hold event, a turn event, and a mark 
event. In particular, a user can point to any of a hold 

2 0 selection 27J , a turn selection 272, and a mark selection 273, 
and then perform the selected motion in the pad area 270. 
Here, a length of hold time or style of dragging a finger for a 
flip command can be gauged for each user, for example, using 
the pad area 270. 

2 5 FIG. 12 is an illustration of the title page of the book 

which is displayed upon exiting the system control page. Here, 
the user is illustrated to select the read-to-me option 244 
which initiates the voice synthesizer 162 to audibly read the 
text being visually displayed on the touchscreen 130. The 

3 0 audible reading of the text begins at the last page which was — 

displayed on the touchscreen 130. The reading rate and other 
controls for the read-to-me routine is provided on a pacing 
control page described hereinafter. 

FIG. 13 is an illustration of the title page of the book 
3 5 wherein a radio frequency link option is selected. This option 
is selected by the user by touching the RF link option 244 
using his or her finger 212. Upon selecting the RF link option 
244, an RF link routine is executed. The RF link routine 
allows the user to download updates of the text to the 
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electronic book, and/or to interface the electronic book to a 
personal computer or communication unit. The RF link routine 
utilizes the antenna 158 and the RF modem 160 illustrated in 
FIG. 3 to communicate with the personal computer using a local 
5 wireless link, or more generally to communicate with a wireless 
data communication network. Utilizing a nationwide wireless 
data communication network, such as the Ardis network, allows 
individuals to receive book updates via radio frequency links 
in major cities. 

10 FIG. 14 is an illustration of the title page of the book 

wherein a pacing control option is selected by a user. 
Specifically/ the user is shown to initiate a pacing control 
routine by selecting the pacing control option 236 displayed on 
the title page using his or her finger 212. 

1 5 FIG. 15 is an illustration of a pacing control page 

displayed in an embodiment of the electronic book. The pacing 
control page is displayed once the user selects the pacing 
control option 236 from the title page. The pacing control 
page includes a display 280 of a current reading pace of the 

2 0 user. Based upon the number of pages left in the book, which 

is given in a display 2B2, a display 284 of an estimated 
completion time for the book is also given. In the embodiment 
of FIG. 15, the current reading pace, the number of pages left, 
and the estimated completion time are displayed in the form of 

2 5 one or more sentences . 

Also displayed on the pacing control page is a display 290 
of a desired reading pace. A display 292 of an estimated 
completion time in accordance with the desired reading pace is 
also given. The desired reading pace is controlled by the user 

3 0 using a graphical slider bar 294. The pages of the text in the 

book are automatically paced by a pacing routine which is 
enabled and disabled by a graphical switch 296. In one 
embodiment, each page of text is displayed for a duration 
. commensurate with the desired reading rate controlled by the 
3 5 graphical slider bar 294. The user returns to the title page 
from the pacing control page by selecting the second hot spot 
portion 178, i.e. the page back portion, of the touchscreen 
130. 



WO 97/22107 PCT/US96/20013 

2 1 

FIG. 16 is an illustration of the title page of the book 
which depicts other user-initiated options. The user can 
return to a book-marked page by selecting the bookmark graphic 
1B2. The user can return to the library screen by selecting 
5 the fourth hot spot portion 184, i.e. the close book portion, 
of the touchscreen 130. The user can go to the first page of 
the book by selecting the first hot spot portion 170, i.e. the 
advance page portion, of the touchscreen 130. 

FIG. 17 is an illustration of a page marked by a dog ear 

10 in an embodiment of the electronic book. The user initiates a 
dog ear command by performing a predetermined user-initiated 
event. An example of such an event includes a user touching an 
upper corner portion of the touchscreen 130, such as the fifth 
hot spot portion 186 defined earlier. 

15 If the page is not dog-eared, then a brief touching of the 

upper corner portion 186 causes a dog ear graphic 300 to be 
displayed in the upper corner portion. In addition, an 
indication that this page has been dog-eared is stored either 
in the removable machine-readable storage medium 136 or the 

20 internal machine-readable storage medium 154. 

If the user touches the upper corner portion 186 of a page 
already marked with a dog ear, or if the upper corner portion 
186 is held for a duration greater than a predetermined 
threshold, then a dog ear dialog box is opened. 

2 5 FIG. 18 is an illustration of a dog ear dialog box used in 

embodiments of the electronic book. A dog ear dialog box 302 
is displayed on touchscreen 130. The dog ear dialog box 302 
displays a list 304 of all dog-eared pages. A user can 
immediately go to one of the dog-eared pages on the list 304 by 

3 0 touching a display of a selected page number. ~ 

The dog ear dialog box 302 also displays an option 306 to 
display marks 308 along an edge 310 of the page. Thereafter, a 
user can touch any of the marks 308 to move quickly to a 
corresponding one of the dog-eared pages. In the example 
3 5 illustrated in FIG. 18, a mark 312 corresponds to marked page 
1, a dog ear 314 corresponds to marked page 35, a mark 316 
corresponds to marked page 94, a mark 318 corresponds to marked 
page 111, and a mark 320 corresponds to marked page 120. In a 
preferred embodiment, page one is always marked with a dog ear 
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so that a user can quickly return thereto using either the 
marks 308 or the dog ear dialog box 302. 

Upon receiving a user-initiated event while the dog ear 
dialog box 302 is displayed, the dog ear dialog box 302 is 
5 removed to show the selected page of the book. 

FIG. 19 is an illustration of a user selecting a portion 
of a page of text. A portion 330 is selected by a user- 
initiated event of sliding his finger 212 (or other pointing 
member such as a stylus) from a first position 332 to a second 

10 position 334. Upon its selection, the portion 330 of the text 
is highlighted in a predetermined manner. The portion 330 of 
the text can be highlighted in color if the touchscreen 130 is 
capable of a color display. Alternatively, the portion 330 of 
the text can be highlighted using grey scale shading, reverse 

15 video, or underlining. An option selection dialog box is then 
displayed on the touchscreen 130 to provide the user a number 
of text marking options. 

FIG. 20 is an illustration of an option selection dialog 
box used in embodiments of the electronic book. An option 

2 0 selection dialog box 340 is displayed on the touchscreen 130 in 
a location out of the way of the portion 330 of the text that 
is marked when possible. The option selection dialog box 340 
includes a plurality of text marking options including a note 
capture option 342, a highlighting option 344, a quote capture 

2 5 option 34 6, and a set bookmark option 34 8. 

Briefly, the note capture option 342 allows a user to type 
in notes associated with the portion 330 of the text. The 
highlighting option 344 leaves the portion 330 of the text 
highlighted, and stores an indication of this highlighting so 

3 0 that any subsequent return to this page displays the portion ~ 

330 as being highlighted- The quote capture option 346 allows 
a user to store the portion 330 of the text along with source 
data, such as the name of the author of the book or the title 
of the book, in the internal machine-readable storage medium 
3 5 154. The set bookmark option 348 can be selected to add a 
bookmark to the current page. If the page already has a 
bookmark, then a number of bookmark management options similar 
to options used for the dog ear command are provided to the 
user. 
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FIG. 21 is an illustration of an annotation display used 
in embodiments of the electronic book. The annotation display 
is provided in response to a user selecting the note capture 
option 34 2 illustrated in FIG. 20. After receiving a user- 
5 initiated event indicative of selecting the note capture option 
342, a soft keyboard 360 is displayed on the touchscreen 130. 
The soft keyboard 360 includes alphanumeric keys and symbolic 
keys along with a close key and a notes collection key. 

A plurality of keystroke events are received by the soft 
10 keyboard 360 to form an annotation. As the keystroke events 
are received, a plurality of characters corresponding thereto 
are displayed in a window 362 on the touchscreen 130. 

The user selects the close key on the soft keyboard 360 
upon completing the annotation. In response to selecting the 

1 5 close key, the electronic book removes the soft keyboard 360 

and the window 362 from the touchscreen 130 and displays a note 
marker icon to indicate that the page has an annotation 
associated therewith. 

The notes collection key on the soft keyboard 360 commands 

2 0 the electronic book to communicate the annotation to an 

external device such as a personal computer. The personal 
computer can be interfaced to the electronic book either 
wirelessly via the antenna 158 and the radio frequency modem 
160 shown in FIG. 3, using a wire-based connection via the data 

2 5 interface 156, or using an infrared link. 

An annotation can also be in the form of an image of 
pixels which overlays the page of the text. The pixels can be 
drawn on the touchscreen 130 using a pointing device. The 
pixels can be stored in a pixel -map form for subsequent viewing 

3 0 or for subsequent conversion to text using a handwriting — 

recognition method. 

As another option, an accessory keyboard can be added to 
the electronic book to enter the annotation as well as other 
information. 

3 5 FIG. 22 is an illustration of a marker used to indicate 

that a page has an annotation associated therewith. The page 
illustrated in FIG. 22 results after the user enters the 
annotation and selects the close key from the soft keyboard 360 
as illustrated in FIG. 21. As shown, the page in FIG. 22 no 
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longer has the soft keyboard 360 and the window 362 displayed 
thereon. However, a note marker icon 370 is displayed in a 
lower corner of the page. The user can view the annotation 
associated with this page by selecting the note marker icon 
5 370. Selecting the note marker icon 370 has the same effect as 
selecting the note capture option 342 as shown in FIG. 20. 

Further, an annotation can be indicated by underlining or 
highlighting the portion of the text associated with the 
annotation. The annotation can be viewed in a hypertext- type 

10 manner by selecting the portion of text. 

FIG. 23 is an illustration of a user selecting a set 
bookmark option in the option selection dialog box. The user 
selects the set bookmark option 348 by touching the displayed 
text associated therewith using his or her finger 212 or other 

15 pointing member. If this page had already included a bookmark, 
then a bookmark management dialog box is displayed similar to 
the one used for the dog ear command. Since the page 
illustrated in FIG. 23 does not have a bookmark associated 
therewith, the selection of the set bookmark option 34 8 causes 

20 a bookmark to be added to the page. In a preferred embodiment, 
only one page is bookmarked within each book. 

FIG. 24 is an illustration of the page of FIG. 23 having a 
bookmark displayed thereon. A bookmark icon 380 is displayed 
in an upper portion of the page to indicate that the paqe has 

2 5 been bookmarked. 

It is noted that pointing devices other than an 
individual's finger may be utilized to generate user-initiated 
events indicative of desired selections using the touchscreen 
130. For example, a stylus or the like can be utilized to 

3 0 select desired portions of the touchscreen 130. ~~ 

It is also noted that various types of graphical controls 
can be utilized to control settings and parameters of the 
electronic book. These graphical controls include, but are not 
limited to, graphical buttons, checkboxes, radio buttons, 
3 5 scroll bars, slider bars, pop-up menus, and dialog boxes. 

Next, a description of steps which are performed by the 
various components of the electronic book to provide its 
features and functionality is presented. These operational 
steps are performed on or with the aid of the processor 152 



WO 97/22 1 07 PCT/US96/2001 3 

25 

illustrated in FIG. 3. The processor 152 is directed to 
function in a manner in accordance with these operational steps 
based upon a computer program or other form of software or 
firmware stored in a computer readable memory. The computer 
5 readable memory can be contained with the processor 152, within 
the internal machine-readable memory 154, or within a separate 
machine-readable storage medium in communication with the 
processor 152. 

It is noted that the order in which the steps are 

1 0 described are indicative of one embodiment of the present 

invention, and that alternative embodiments of the present 
invention may perform the steps in a different order to achieve 
the same functionality. 

FIG . 25 is a flow diagram of an event loop performed in an 
15 embodiment of the electronic book. As indicated by block 400/ 
a step of executing a library graphical user interface routine 
is performed. The library graphical user interface routine 
provides a virtual library to allow a user to select a book to 
read from a plurality of books within a library, and/or access 

2 0 an information service or world-wide web page as previously 

described. The plurality of books can be contained in one or 
more removable machine-readable storage media and/or the 
internal machine-readable storage medium. 

Upon selecting a desired book, a step of executing a 

2 5 routine to display one or more pages of text and graphics from 

the desired book is performed as indicated by block 402. The 
routine to display the pages of text is executed until a 
predetermined user-initiated event is received to exit the 
routine. As indicated by block 404, if a close book event is 

3 0 received, then flow of the event loop is directed back to the — 

step of executing the library graphical user interface routine 
in block 400. 

If a page back event is received when the current page of 
text being read is page one, then a step of displaying a title 
3 5 page of the book is performed as indicated by block 406. The 
title page provides a number of control options available to a 
user. The user selects a desired control option based upon a 
user-initiated event. Block 408 indicates a step of receiving 
this user-initiated event. 
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Based upon the user-initiated event which is received, 
flow of the event loop is directed to one of a number of 
subroutines in a step indicated by block 410. If the received 
event is indicative of the user selecting the pacing control 
5 option, then a step of executing a pacing control routine is 
performed as indicated by block 412. If the received event is 
indicative of the user selecting the font selection option, 
then a step of executing a font selection routine is performed 
as indicated by block 414. If the received event is indicative 

1 0 of the user selecting the system control option, then a step of 

executing a system control subroutine is performed as indicated 
by block 416. If the received event is indicative of the user 
selecting the RF link option, then a step of executing an RF 
link subroutine is performed as indicated by block 4 20. Upon 
15 completing either the pacing control subroutine, the font 

selection routine, the system control routine, or the RF link 
routine, flow of the event loop is directed back up to block 
4 06 wherein the step of displaying the title page is performed. 
If the received event from block 408 is indicative of the 

2 0 user selecting the read-to-me option, then a step of executing 

a read-to-me routine is performed as indicated by block 422. 
Flow of the event loop is then directed back to block 4 02 to 
execute the routine to display pages of text from the book. 
The execution of the read-to-me routine in block 422 provides a 

2 5 spoken, auditory display of the text in addition to the visual 

display of the text in block 402. 

If the event received in the step of block 408 is an 
advance page event, then a step of setting the current page to 
page one is performed as indicated by block 4 24. If the 

3 0 received event is indicative of the user selecting a bookmarks- 

displayed on the title page, then a step of setting the current 
page to a previously bookmarked page is performed as indicated 
by block 426. After the current page is set in either of the 
steps indicated by blocks 424 and 4 26, then flow of the event 
3 5 loop is directed back to the step of executing the routine to 
display pages of text indicated by block 402. 

Finally, if the event received in block 4 08 is indicative 
of a close book event, then flow of the event loop is directed 
back to block 400 to perform a step of executing the library 
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graphical user interface routine. 

FIG. 26 is a flow diagram of steps performed in an 
embodiment of a library graphical user interface routine for 
use in the electronic book. These steps can be performed in 
5 executing the library graphical user interface routine 

indicated by block 400 in FIG . 25. The steps provide a method 
of selecting a book for reading in an electronic book where the 
book is selected from a plurality of books in a library. 

As indicated by block 430, a step of displaying a rearward 

1 0 graphical book representation having a graphical spine portion 

is performed. A step of displaying a forward graphical book 
representation in front of the rearward graphical book 
representation is performed as indicated by block 432. The 
forward graphical book representation has a graphical spine 
15 portion and a graphical front cover portion. 

As indicated by block 4 34, a step of displaying a title of 
a first book of the plurality of books on the forward graphical 
book representation is performed. The title of the first book 
can be displayed anywhere on the forward graphical book 

2 0 representation. However, in a preferred embodiment, the title 

of the first book is displayed on the graphical spine portion 
of the forward graphical book representation. FIG. 5 
illustrates an example of the rearward graphical book 
representation 200 having the graphical spine portion 202, the 

2 5 forward graphical book representation 204 having the graphical 

spine portion 206 and the graphical front cover portion 208, 
and the title 210 displayed on the forward graphical book 
representation 204. 

With reference again to FIG. 26, a step of receiving a 

3 0 first user-initiated event in which a portion of the rearward — 

graphical book representation is selected is performed as 
indicated by block 436. In a preferred embodiment, the portion 
of the rearward graphical book representation selected in this 
step is within the graphical spine portion of the rearward 
3 5 graphical book representation. Upon receiving the first user- 
initiated event, a step of displaying a title of a second book 
of the plurality of books is performed as indicated by block 
440. Preferably, the title of the second book is displayed in 
place of the title of the first book on the graphical spine 
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portion of the forward graphical book representation. 

As indicated by block 44 2, a step is performed of 
receiving a second user-initiated event in which a portion of 
the forward graphical book representation is selected- In a 
5 preferred embodiment, the portion of the forward graphical book 
representation selected in this step is within the front cover 
portion of the forward graphical book representation. The 
reception of the second user-initiated event ends the execution 
of the library graphical user interface routine, and flow is 
1 0 directed to the routine to display pages of text from the 
second book. Here, steps are performed of reading machine- 
readable data from a machine-readable storage medium installed 
in the electronic book, the machine- readable data being 
representative of text from the second book, and displaying the 

1 5 text represented by the machine-readabl e data . 

It is noted that the steps indicated by blocks 436 and 440 
can be repeated to allow the user to rotate through the 
plurality of books. When the first user— initiated event is 
received while a last of the plurality of books is displayed, 

2 0 the next title displayed is that of the first of the plurality 

of books . 

It is preferred that steps of displaying and receiving 
user-initiated events all be performed using the touchscreen 
130 integrated in the electronic book. However, in alternative 

2 5 embodiments of the electronic book which include a series of 

buttons external to the touchscreen 130, any of the above- 
described user-initiated events may be received using these 
buttons . 

Moreover, it is noted that more than two graphical book 

3 0 representations can be displayed to provide control in the w 

library graphical user interface routine. 

FIGS. 27 and 28 show flow diagrams of an embodiment of the 
routine to display pages of text in the electronic book. The 
steps indicated in these flow diagrams are performed in one 
3 5 embodiment of the step indicated by block 402 in FIG. 25. 

Upon entering the routine, a step of displaying a current 
page of the book is performed as indicated by block 4 SO. The 
current page includes text from the current page of the book, a 
graphical display of a number of pages remaining in the book, a 



WO 97/22107 PCT/US96/20013 

29 

display of a bookmark graphic if there is a bookmark associated 
with the current page, a dog ear graphic if the current page is 
dog-eared, and a note marker icon if there is an annotation 
associated with the current page. Optionally, the current page 
5 includes graphics from the current page of the book. 

After displaying the current page, a branching step is 
performed, as indicated by block 4 52, based upon any user- 
initiated events which are received. If a user-initiated event 
is received which selects a portion of the text, a step of 

1 0 marking the portion of the text is performed as indicated by 

block 454. The portion of the text can be marked either by 
color or grey scale highlighting the portion of the text, 
underlining the portion of the text, or displaying the portion 
of the text in a reverse video form. The portion of the text 
1 5 can be selected directly by a user sliding a finger or a stylus 
over the portion of the text. Alternatively, the portion of 
the text can be selected indirectly by a menu selection 
technique . 

After the portion of the text has been marked, a step of 

2 0 displaying an option selection dialog box is performed as 

indicated by block 456. The option selection dialog box 
provides a plurality of options to the user, including a note 
capture option, a highlighting option, a quote capture option, 
and a set bookmark option. 

2 5 As indicated by block 460, a step of receiving a user- 

initiated event indicative of a selection of one of the options 
is performed. Based upon the selection, a branching step is 
performed as indicated by block 462. If the note capture 
option is selected, then a step of executing an annotation 

3 0 subroutine is performed as indicated by block 464. If the — 

quote capture option is selected, then a step of executing a 
quote capture subroutine is performed as indicated by block 
466. If the highlighting option is selected, then a step of 
executing a highlighting subroutine is performed as indicated 
3 5 by block 470. If the set bookmark option is selected, then a 
step of executing a bookmark subroutine is performed as 
indicated by block 4 72. 

Upon completing the execution of either the annotation 
subroutine, the quote capture subroutine, the highlighting 
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subroutine, or the bookmark subroutine, a step of determining 
whether a pacing mode is active is performed as indicated by 
block 474. If the pacing mode is inactive, then flow of the 
routine is directed back to block 4 52 which performs a 
5 branching step based upon a received user-initiated event. If 
the pacing mode is active, then a step of determining whether a 
highlighting mode is active is performed as indicated by block 
476. If the highlighting mode is active then a step of 
scrolling a highlight across the current page is performed as 

10 indicated by block 480. Scrolling the highlight across the 
current page allows pacing of a user's scanning across the 
current page. A user can activate the highlighting mode to 
help enhance his or her reading speed. 

The highlight which is scrolled across the page can be in 

15 the form of either a color or grey scale highlight , an 

underlining of text, or a reverse video form of text. If the 
touchscreen 130 is capable of selective backlighting, then the 
highlight can be in the form of a selective backlighting of a 
reduced portion of the touchscreen 130. 

2 0 After scrolling the highlight across the current page in 

block 480 or if the highlighting mode is inactive, then a step 
of determining whether it is time for displaying a subsequent 
page is performed as indicated by block 482. If the time has 
not yet come for displaying a subsequent page, then flow is 

2 5 directed back to block 4 52. If the time has arrived for 

displaying a subsequent page, then a step of updating the 
current page is performed as indicated by block 484. Next, a 
step of displaying a forward page turn in an animated matter is 
performed as indicated by block 486. This step includes 

3 0 displaying an animated sequence of images which simulates a ~ 

forward flipping of a page. Flow of the routine is then 
directed back to block 450 to display the new current page. 

With reference to block 452, if a user-initiated event is 
received indicative of the user selecting the note marker icon, 
3 5 then the step of executing the annotation routine indicated by 
block 4 64 is performed. Thereafter, subsequent steps are 
performed beginning with the step indicated by block 474 . 

With reference to the branching step performed in block 
452, if a dog ear user-initiated event is received, then a step 
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of executing a dog ear routine is performed as indicated by 
block 490. If the user-initiated event is indicative of the 
user selecting the bookmark portion of the page, then a step of 
executing a bookmark management routine is performed as 
5 indicated by block 491. Thereafter, subsequent steps are 
performed beginning with the step indicated by block 474. 
Similarly, if no user-initiated events are received in block 
4 52, then flow of the routine is directed to the step indicated 
by block 474 . 

1 0 If the user-initiated event is indicative of the user 

selecting the page back portion of the page, then flow from 
block 452 branches to a step of decrementing the current page 
as indicated by block 492. Further, a step of displaying a 
backward page turn in an animated matter is performed as 

15 indicated by block 494. This step includes displaying an 

animated sequence of images which simulates a backward flipping 
of a page. The steps indicated by blocks 486 and 494 qive the 
user the sense or feel that a page of information is being 
turned in place, carrying forward the familiar paradigm of 

20 turning the page on a standard paper book. 

As indicated by block 496, a step of determining whether 
the new current page is the title page is performed after the 
step of block 494. If the new current page is the title page, 
then execution of the routine to display pages of text in the 

2 5 electronic book is completed as indicated by block 500,. If the 

new current page is any page but the title page, then flow of 
the routine is directed back to block 4 50 wherein a step of 
displaying the new current page is performed. 

If the user-initiated event is indicative of the user 

3 0 selecting the advance page portion of the page, then flow is - 

directed from the step indicated by block 4 52 to a step of 
incrementing the current page as indicated by block 502. 
Further, a step of displaying a forward page turn in an 
animated matter is performed is indicated by block 504. Flow 
3 5 of the routine is then directed back to block 4 50 wherein the 
new, incremented current page is displayed. 

FIG. 29 is a flow diagram of steps performed to display a 
current page in the electronic book. These steps constitute 
one embodiment of a method of performing the step indicated by 
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block 4 50 in FIG. 27. 

As indicated by block 510, a step of displaying text from 
the current page of the book is performed . The text is 
displayed in accordance with a primary font parameter and a 
5 primary size parameter. If there is any highlighting 

associated with a portion of the text on the current page, then 
a step of displaying the portion of the text in a highlighted 
manner is performed as indicated by block 512. If any 
graphical information is included in the current page, then a 
1 0 step of displaying the graphical information is performed as 
indicated by block 513. 

As indicated by block 514 , a step of graphically 
displaying a number of pages remaining in the book is 
performed. The number of pages remaining in the book can be 

1 5 displayed in the sixth portion 188 of the touchscreen 130 as 

illustrated in FIG. 4. The number of pages remaining in the 
book can be graphically displayed using either an image of a 
number of pages, a dark line as a drop shadow, or a group of 
parallel lines to indicate relative depth by page number in a 

2 0 given document. When the current page is one of the early 

pages in the book, the drop shadow or graphical image depth is 
relatively deep, indicating that there is a significant portion 
of the book remaining to be read. When the current page is 
near the middle of the book, the drop shadow or graphical image 

2 5 depth is half as deep. When nearing the end of the book, the 

drop shadow or graphical image depth becomes very thin 
indicating that the reader is almost at the end of the book . 
As a result, the user can determine at a glance how much of the 
book has been read, and their relative position within the book 

3 0 just as a standard paper book. As an alternative to using a ~ 

top portion of the touchscreen for graphically displaying the 
number of pages remaining in the book, a side edge and/or a 
bottom edge of the touchscreen 130 can be utilized to provide 
this graphical display. 
3 5 As indicated by block 516, a step of determining if a 

bookmark is associated with the current page is performed. If 
a bookmark is associated with the current page, then a step of 
displaying a bookmark graphic is performed as indicated by 
block 520. 
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As indicated by block 522, a step of determining if the 
current page is dog-eared is performed. If the current page is 
dog-eared, then a step of displaying a dog ear graphic is 
performed as indicated by block 524. 
5 As indicated by block 526, a step of determining whether 

an annotation exists for the current page is performed. If 
there is an annotation associated with the current page, then a 
step of displaying a note marker icon is performed as indicated 
by block 530. 

10 FIG . 30 is a flow diagram of steps performed in an 

embodiment of an annotation routine. Such an annotation 
routine is executed in the step indicated by block 464 in FIG. 
28. 

As indicated by block 54 0, a step of displaying a window 

1 5 for displaying the annotation is performed. As indicated by 

block 542, a step of displaying a soft keyboard on the 
touchscreen 130 is performed. The soft keyboard is provided to 
receive a plurality of keystroke events to form the annotation. 
After displaying the soft keyboard and the annotation 

2 0 window, a step of receiving a keystroke event is performed as 

indicated by block 544. As indicated by block 546, a branching 
operation is performed based upon the keystroke event received 
in block 544. If the keystroke event is indicative of the user 
selecting either an alphanumeric key or a symbolic key on the 

2 5 soft keyboard, then a step of displaying a character associated 

with the key is performed as indicated by block 560. The 
character associated with the key is displayed within the 
annotation window. After displaying the character, flow of the 
routine is directed back to block 544 wherein a subsequent 

3 0 keystroke event is received. — 

Referring back to the branching step indicated by block 
546, if the keystroke event is indicative of a user selecting 
the close key from the soft keyboard, then a step of closing 
the soft keyboard is performed as indicated by block 562. A 
3 5 step of closing the annotation window is also performed, as 
indicated by block 564. As indicated by block 566, a step of 
displaying a note marker icon on the page is performed. 
Thereafter, execution of the annotation subroutine is 
completed . 



WO 97/22107 PCT/US96/20OI3 

34 

With reference again to the branching step performed in 
block 54 6, if the keystroke event is indicative of the user 
selecting the notes collection key, then a step of 
communicating the annotation to an external personal computer 
5 is performed as indicated by block 570. After communicating 
the annotation to the personal computer, flow of the routine is 
directed back to block 544 wherein a subsequent keystroke event 
is received. 

FIG. 31 is a flow diagram of steps performed in an 

1 0 embodiment of a quote capture subroutine . Such a quote capture 

subroutine can be performed to provide the step indicated by 
block 466 in FIG. 28. 

Prior to entering the quote capture subroutine, a user- 
initiated event was received in the electronic book which 
15 selects a portion of the text displayed on the touchscreen. 
After receiving the user- initiated event, a plurality of text 
marking options, including a quote capture option, is 
displayed, and a user-initiated event indicative of a user 
selecting the quote capture option is received. 

2 0 As indicated by block 580, a step of storing quote data 

representative of the portion of the text is performed. The 
quote data is stored in the internal machine-readable storage 
medium 154 illustrated in FIG. 3. 

As indicated by block 582, a step of storing source data 

2 5 which identifies the source of the quote data is performed. 

The source data can be representative of the author of the 
book, the title of the book, a copyright date of the book, 
and/or a publisher of the book. The source data is stored in 
the internal machine-readable storage medium 154 from FIG. 3. 

3 0 As indicated by block 584, a step is performed of — 

maintaining the quote data and the source data in the internal 
machine— readable storage medium when the removable machine- 
readable storage medium is removed from the electronic book. 
As a result of this step, subsequent steps can be performed 
3 5 based upon the quote data and the source data when the 
removable machine-readable storage medium is removed. 
Specifically, a step of retrieving the quote data and the 
source data from the internal machine-readable storage medium 
can be performed when the removable machine-readab.1 e storage 
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medium is removed from the electronic book. Thereafter, a step 
of displaying the portion of the text represented by the quote 
data and source information represented by the source data can 
be performed. 

5 FIG. 32 is a flow diagram of steps performed in an 

embodiment of a dog ear subroutine. Such a dog ear subroutine 
is executed in the step indicated by block 490 in FIG. 27. 

As indicated by block 590, a step is performed of 
determining a duration in which a dog ear portion of the 

1 0 touchscreen is held . A step of comparing the duration to a 

predetermined threshold is performed as indicated by block 592. 
The predetermined threshold can be about a second. If the 
duration is less than the predetermined threshold, then a step 
of determining whether the current page has a dog ear is 
15 performed as indicated by block 594. If the current page does 
not have a dog ear, then a step of storing an indication that 
the current page be dog-eared is performed as indicated by 
block 596. Further, a step of displaying a dog ear graphic in 
an upper corner portion of the touchscreen 130 is performed as 

2 0 indicated by block 600. Thereafter, execution of the dog ear 

subroutine is completed . 

With reference to blocks 592 and 594, if the duration is 
greater than or equal to the predetermined threshold or if the 
current page is already dog-eared, then a step of displaying a 

2 5 dog-eared dialog box is performed as indicated by block 602. 

Within the dog-eared dialog box, a list of all marked pages is 
displayed. Further, an option to show marks corresponding to 
all of the marked pages along an edge of each page is 
displayed. 

As indicated by block 604, a user-initiated event is ~ 
received. As indicated by block 606, a branching step is 
performed based upon the user-initiated event received. if the 
user-initiated event is indicative of a user selecting a page 
number from the list of marked pages, then a step of setting 

3 5 the current page to the selected page number is performed as 

indicated by block 610. If the user-initiated event is 
indicative of the user selecting the marking option, then a 
step of displaying marks corresponding to the doq-eared pages 
along an edge of the page is performed as indicated by block 
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612. 

FIG. 33 is a flow diagram of steps performed in an 
embodiment of a pacing control subroutine. The pacing control 
subroutine is executed in the step indicated by block 472 in 
5 FIG. 25. 

As indicated by block 620, a step of determining a number 
of pages remaining in the book is performed. As indicated by 
block 622, a step of determining a current reading pace of the 
user is performed. 

1 0 Based upon the number of pages remaining in the book, a 

step of calculating one or more estimated completion times is 
performed as indicated by block 624. A first estimated 
completion time can be calculated by dividing the number of 
words or pages remaining in the book by the current reading 
15 pace of the user. As a result, the first estimated completion 
time estimates how long it would take the user to complete the 
book at his or her current reading pace. A second estimated 
completion time is calculated by dividing the number of words 
or pages remaining in the book by a desired reading pace. The 

2 0 second estimated completion time estimates how long it would 

take the user to complete the book at the desired reading pace. 

As indicated by block 626, a step of displaying each 
estimated completion time is performed. Each estimated 
completion time can be displayed within a corresponding 

2 5 sentence as illustrated in FIG. 15. 

As indicated by block 630, a step of calculating a 
necessary reading pace to satisfy a predetermined reading goal 
is performed. The predetermined reading goal can be in the form 
of a time duration within which a user wishes to complete the 

3 0 pages remaining in the book. Here, the necessary reading pac£~ 

is calculated by dividing the number of pages remaining in the 
book by the time duration. A step of displaying the necessary 
reading pace to satisfy the reading goal is then performed as 
indicated by block 632. 
3 5 As indicated by block 634, a step of displaying one or 

more graphical pacing controls is performed. As illustrated in 
FIG. 15, the one or more graphical pacing controls can include 
a graphical slider bar such as the graphical slider bar 294 
used for modifying the desired reading pace, and a graphical 
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switch such as the graphical switch 296 which is used for 
enabling and disabling an automatic pacing of the text using a 
pacing routine. 

As indicated by block 636 , a user-initiated event is 
5 received. As indicated by block 640, if the user-initiated 

event is indicative of the user selecting the page back portion 
of the touchscreen 130, then execution of the pacing control 
subroutine is terminated. Upon terminating the pacing control 
subroutine, the system control page is displayed on the 

10 touchscreen 130. 

If the user-initiated event is not indicative of the user 
selecting the page back portion, then a step of updating a 
pacing parameter based on the user-initiated event is performed 
as indicated by block 64 2. Examples of the pacing parameter 

15 include the desired reading pace and the reading goal. After 
updating the pacing parameter, flow of the subroutine is 
directed back to block 624 to recalculate an estimated 
completion time and the necessary reading pace. 

FIG. 34 is a flow diagram of steps performed in an 

2 0 embodiment of the font selection subroutine. The font 

selection subroutine is executed in block 414 in the event loop 
of FIG. 25. 

As indicated by block 650, a step of displaying a 
plurality of words using a corresponding plurality of 

2 5 combinations of different fonts and different sizes is 

performed. More specifically, each word is displayed using a 
specific font and a specific size in accordance with the 
combination corresponding thereto. Optionally, the step of 
displaying the plurality of words can include displaying a 

3 0 respective font name for each of the combinations. As another* 

option, the step of displaying the plurality of words can 
include displaying a single textual expression using the 
corresponding plurality of combinations. 

As indicated by block 652, a step of receiving a user- 
3 5 initiated event indicative of the user selecting one word of 
the plurality of words is performed. This selection indicates 
which font/size combination is desired by the user. 

As indicated by block 654 , a step of updating a primary 
font parameter and a primary size parameter is performed. The 
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primary font parameter and the primary size parameter are 
updated in accordance with the font/size combination selected 
by the user. As indicated by block 656, a step of 
automatically returning to displaying the title page is 
5 performed after receiving the user- initiated event selecting 
the one word. Thereafter, a subsequent step of displaying text 
of a book includes displaying the text using the primary font 
in a size at least the primary size. 

FIG. 35 is a flow diagram of steps performed in an 
10 embodiment of the system control subroutine. The system 

control subroutine is executed in the step indicated by block 
416 in the event loop of FIG. 25. 

As indicated by block 660, a step of displaying a 
plurality of graphical controls for setting system parameters 

1 5 is performed. The system parameters can include display 

parameters such as a contrast parameter, a tint parameter, and 
a color parameter. The system parameters can also include a 
sound parameter . 

As indicated by block 662, a step of receiving a user- 

2 0 initiated event is performed. If the user-initiated event is 

indicative of the user selecting the page back portion of the 
touchscreen, as indicated by block 664, then execution of the 
system control subroutine is completed. For other user- 
initiated events, a step of updating a system parameter is 

2 5 performed as indicated by block 668. 

Thus, there has been described herein a concept, as well 
as several embodiments including preferred embodiments of an 
electronic book and a graphical user interface to provide 
control thereof to a user. 

3 0 Because the various embodiments of the present invention** 

designate portions of a touchscreen integrated in the 
electronic book to receive user- initiated events to control the 
operation of the electronic book in a manner consistent with a 
book metaphor, they provide a significant improvement in that 
3 5 the user can easily control the operation in an intuitive 
manner . 

Additionally, the various embodiments of the present 
invention provide designated portions of the touchscreen 
consistent with a book metaphor to allow the user either to: 
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(i) request a subsequent page to be displayed; (ii) request 
that a previous page be displayed; (iii) request that a pre- 
marked page be displayed; (iv) request that a library screen be 
displayed; and (v) request that a page be marked. 
5 It will be apparent to those skilled in the art that the 

disclosed invention may be modified in numerous ways and may 
assume many embodiments other than the preferred form 
specifically set out and described above. 

Accordingly, it is intended by the appended claims to 
1 0 cover all modifications of the invention which fall within the 
true spirit and scope of the invention. 

What is claimed is: 
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Claims 

1. A method of providing control of an electronic book 
to a user, the electronic book having a book-shaped housing, 

5 the method comprising the steps of: 

reading machine-readable data from a machine-readable 
storage medium installed in the electronic book, the machine- 
readable data representative of text from a book; 

displaying a page of the text represented by the machine- 
1 0 readable data on a display portion of a touchscreen integrated 
in the electronic book; 

designating a first portion of the touchscreen for 
receiving a first user-initiated event which requests that a 
subsequent page of the text be displayed on the touchscreen; 

1 5 designating a second portion of the touchscreen for 

receiving a second user-initiated event which requests that a 
previous page of the text be displayed on the touchscreen; 

designating a third portion of the touchscreen for 
receiving a third user-initiated event which requests that a 

2 0 pre-marked page be displayed on the touchscreen; 

designating a fourth portion of the touchscreen for 
receiving a fourth user-initiated event which requests that a 
library screen be displayed on the touchscreen; and 

designating a fifth portion of the touchscreen for 

2 5 receiving a fifth user-initiated event which requests that the 

page be marked. 

2. An electronic book comprising: 

a book-shaped housing having a first housing member 

3 0 pivotably connected to a second housing member to facilitate * 

opening and closing in a book-like manner; 

a processor housed by the book-shaped housing, the 
processor operative to read machine-readable data from a 
machine-readable storage medium installed in the electronic 
3 5 book, the machine-readable data representative of text from a 
book ; and 

a touchscreen in communication with the processor and 
integrated in the book-shaped housing, the touchscreen 
operative to display a page of the text represented by the 
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machine- readable data in a display portion, the touchscreen 
having a first portion for receiving a first user-initiated 
event which requests that a subsequent page of the text be 
displayed on the touchscreen, a second portion for receiving a 
5 second user-initiated event which requests that a previous page 
of the text be displayed on the touchscreen, a third portion 
for receiving a third user-initiated event which requests that 
a pre-marked page be displayed on the touchscreen, a fourth 
portion for receiving a fourth user-initiated event which 
10 requests that a library screen be displayed on the touchscreen, 
and a fifth portion for receiving a fifth user-initiated event 
which requests that the page be marked. 



3. The electronic book of claim 2 wherein the display 
15 portion, the first portion, the second portion, the third 

portion, the fourth portion, and the fifth portion are mutually 
exclusive portions of the touchscreen. 

4 . The electronic book of claim 2 wherein the first 
2 0 portion includes a side margin portion located beside the 

display portion. 



5. The electronic book of claim A wherein the first 
portion includes a top margin portion located above the display 

2 5 portion and a bottom margin portion located below the display 

portion . 

6. The electronic book of claim 4 wherein the second 
portion includes a side portion located beside the display 

3 0 portion and opposite the side margin portion. ~ 

7. The electronic book of claim 2 wherein the fourth 
portion is located beside the second portion. 

3 5 8. The electronic book of claim 2 wherein the third 

portion is located in an upper portion of the touchscreen. 



9. The electronic book of claim 8 wherein the third 
portion is shaped as a bookmark. 
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10. The electronic book of claim 2 wherein the fifth 
portion is located in an upper corner of the touchscreen. 
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